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1. 


Introduction 


The  purpose  of  science,  it  is  said,  is  **to  understand  the  present, 
to  interpret  the  past,  to  predict  the  future.*'  To  achieve  these  aims,  it 
attempts  to  determine  the  relations  between  different  physical  quantities 
which  it  expresses  in  the  forms  of  theories  (or  "laws**)  abstracted  from 
observations . 

In  many  scientific  fields,  the  basic  data  are  obtained  in  the  form 
of  time  series  (that  is,  the  data  consist  of  a  set  of  observations,  each 
associated  with  a  particular  point  of  time.)  Thus  if  one  is  studying 
temperature  variations,  one  might  begin  by  obtaining  records  of  daily 
mean  temperatures  at  various  stations.  If  one  is  studying  death  rates, 
one  might  begin  by  obtaining  records  of  annuel  mortality  rates  in  various 
age  groups.  Consequently,  the  problem  of  time  series  analysis  plays  a 
role  in  all  scientific  fields. 

In  analyzing  time  series  representing  the  behavior  of  physical 
phenomena  over  time,  one  of  the  main  approaches  of  researchers  has  been 
to  look  for  features  which  recur  systematically  after  fixed  periods  of 
time,  so  that  their  occurrence  can  be  accurately  foreseen.  By  the  success¬ 
ful  application  of  such  an  approach,  man  is  able  to  predict  the  tides 
and  the  times  of  sunrise  and  sunset.  Consequently,  among  the  problems 
which  historically  came  to  be  considered  in  time  series  analysis  were 
the  problems  of  detecting  hidden  periodicities  and  of  measuring  seasonal 
variation . 

These  classical  problems  are  nowadays  being  approached  as  part  of 
the  overall  problem  of  statistical  spectral  analysis .  Statistical  spectral 
analysis  may  be  defined  as  a  theory  which  seeks  to  provide  a  method 
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whereby  from  observed  records,  of  finite  length,  of  an  engpirical  phenome¬ 
non  one  can  interpret  the  time  functions  representing  the  phenomenon  as 
a  superposition  (finite  or  infinite  linear  conibination)  of  harmonics 
cos  u)t  and  sin  urb. 

The  aim  of  this  paper  is  to  systematically  develop  some  basic  ideas 
about  Fourier  analysis  and  spectral  windows.  The  author  hopes  to  show 
in  later  publications  [see  Parzen  (1965)]  the  usefulness  of  these  ideas 
in  obtaining  a  practical  solution  to  the  problems  of  statistical  spectral 
analysis . 

The  paper  consists  of  five  sections:  (l)  introduction,  (2)  the 
Fourier  coefficients  of  a  periodic  functions,  (5)  windows,  (i^-)  coeffi¬ 
cient  windows,  (5)  evaluation  of  Fourier  coefficients  using  equi- spaced 
points . 
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2. 


The  Fourier  coefficients  of  a  periodic  function. 


One  approach  to  the  problem  of  meas\iring  or  representing  a  function 
defined  on  an  interval  is  ^o  try  to  summarize  the  function  f  ( • )  by  a 
finite  nximber  of  coefficients.  Various  n^thods  of  doing  this  are  examined 
in  this  section. 

Periodic  functions .  A  time  function  f ( • )  is  said  to  be  periodic ^ 
with  period  6,  if,  for  all  t  >  0, 

f(t)  =  f(t  +  k0)  for  all  integers  k  . 

The  period  of  a  periodic  function  is  not  unique,  since  if  it  has  period 
0  it  also  has  period  26,  ^6,  ...  . 

One  often  assumes  time  to  be  measured  in  months.  A  periodic  function 
f  ( • )  with  period  one  year  then  has  period  0  =  12;  that  is,  for  all 
t  >  0  and  integers  k  =  1,  2,  ...  , 

f(t)  =  f(t  +  12)  =  f(t  +  24)  =  ...  =  f(t  +  12k)  . 

Frequency:  A  function  f(t)  is  said  to  be  a  (real)  harmonic  with 
frequency  w  and  amplitude  A,  where  u)  and  A  are  positive  constants, 
if  it  is  of  the  form 


f(t)  =  A  cos  oot 


or  of  the  form 


f(t)  =  A  sin  cJt  . 


A  harmonic  with  frequency  u)  has  period 


e  = 


2jt 

u) 


since  for  any  integer  k 

cos[(x)(t  +  —  k)]  =  cos  (art  +  2nk)  =  cos  ut 

Ptr 

sin[u)(t  +  —  k)]  =  sin(art  +  2jtk)  =  sin  a)t  . 


If  a  harmonic  has  period  0,  its  frequency  o)  must  satisfy 


0)  =  k  -X  ^*or  some  integer  k  =  1,  2,  . . . 

u 


since 


cos[a)(t  +  0)]  =  cos  art  implies 


0  =  k 


2jt 

0) 
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Physical  Interpretation  of  frequency,  lypicai  harmonics  are  sketched 


below: 


The  period  G  is  given  by  the  distance  from  peak  to  peak,  or 
equivalently  it  is  given  by  the  distance  from  trough  to  trough.  The 
frequency  w  represents  the  nu2±ier  of  complete  cycles  (or  swings)  in 
2jt  units  of  time;  it  is  therefore  called  the  angular  or  radian  frequency, 
to  distinguish  it  from  true  frequency  v,  measured  in  cycles  per  unit 
time .  The  true  frequency  v  of  a  harmonic  with  angular  frequency  cj 
is  given  by 


V 


U) 

2rt 


To  illustrate  these  ideas  suppose  that  time  t  is  measured  in 

2it 

months.  The  harmonics  cos  orb  and  sin  u)t  have  period  —  and  repre- 

CJ 
2  It 

sent  variations  which  rec\ir  every  —  months.  Thus  the  harmonics 
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cos 


t  and  sin  t  have  period  6  and  represent  values  which 
recur  every  6  ninths.  The  true  frequency  of  these  harmonics  is  ^ 
which  means  that  in  one  unit  of  time  (here,  one  month)  ^  of  a  swing 
takes  place. 

Zero  frequency.  A  constant  function 


f(t)  =  A 

can  be  regarded  as  the  value  of  the  harmonic  A  cos  u)t  with  frequency  u) 
equal  to  zero.  Consequently,  by  a  zero  frequency  harmonic  we  mean  a 
constant . 

Expansion  of  a  periodic  function  into  harmonics .  It  is  a  very 
remarkable  fact  that  a  function  f(t)  with  period  6  can  be  arbitrarily 
closely  approximated  by  a  linear  combination 

(1)  f  (t)  =  £  (A^  cos(n  "t)  +  sin(n  ^  t)} 

n=0 

2jt 

of  the  harmonics  with  frequencies  It-r-,  k  =  0,  1,  2,  . . .  .  A  function 

u 

of  the  form  of  (l)  is  called  a  harmonic  polynomial  of  degree  N  and 
period  0. 

There  are  many  senses  in  which  one  can  define  closeness  of  approxima¬ 
tion.  Consequently,  in  order  to  form  the  harmonic  polynomial  which 
approximates  a  periodic  function  one  must  first  define  the  mode  of 


approximation . 


Least  sguares  approximation  over  an  Interval.  Let  f(t)  be  a 
periodic  function  with  period  0.  In  studying  this  function  we  can 
confine  our  attention  to  the  interval  0  <  t  <  0,  since  whatever  happens 
in  this  interval  is  repeated  outside  of  it. 

One  sense  in  which  a  harmonic  polynomial  degree  N  and 

period  6  can  be  said  to  be  a  good  approximation  to  f(t)  is  if  the 
integrated  square  difference 

(2)  {f(t)  -  dt 

is  as  small  as  possible;  more  precisely,  the  harmonic  polynomial 
defined  by  (l)  is  called  the  least  squares  approximation  to  f(t)  by  a 
harmonic  polynomial  of  degree  N  if 

(3)  [  (f(t)  -  dt  =  min  S(aQ,a^,b^, . . 

0  aQ,a^,b^,  ...,ajj,bjj 

where 


(4) 


=  f  [f(t)  -  {a  cos(n  ^  t)  +  b^  3in(n  ^  t)}]^  dt  . 

Jq  n=0 


To  determine  ^  finds  the  roots  of  the  deriva' 

tives  and  for  m  =  0,  1,  ...  ,  N.  Proceeding  in  this  way 

m  m 

one  arrives  at  the  following  conclusion. 
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Normal  equations  for  the  coefficients  of  the  least  squares  approxi¬ 


mating  harmonic  polynomial.  The  coefficients  *•*  »  ^^®N 

are  the  solution  of  the  system  of  linear  equations  [for  m  =  0>  1,  ...  ,  N] 


N  r 

/ 

n=0  -'O 


e  re 

cos  u)  t  cos  u)  t  dt  +  B  /  sin  w  t  cos  u)  t  dt) 

^Jo 


n  m 


n  m 


I  f(t)  cos  u)  t  dt  4 

Jo  ^ 


(5) 


N  r 

^0 


e  re 

cos  0)  t  sin  u)  t  dt  +  B  /  sin  u  t  sin  u)  t  dt) 

nj. 


n  m 


tit)  sin  u)  t  dt  , 


n  m 


where 


(6) 


0) 

n 


n 


e  • 


The  solution  of  these  equations  is  rendered  trivial  by  the  following 
easily  verified  facts: 


(7) 


/ 


cos  u)  t  cos  0)  t  dt  =  0 
n  m 


sin  0)  t  sin  o)  t  dt  =  0 
n  m 


sin  u)  t  cos  w  t  dt  =  0  . 
n  m 


if  n  /  m  . 
if  n  ^  m  . 
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if  n  >  0  . 

if  n  =  0  . 

if  n  >  0  . 

if  n  =  0  . 


Consequently,  the  least  squares  approximating  harmonic  polynomial  of 
degree  N  to  the  function  f(t)  over  the  interval  0  to  9  is  given 
by  (l)  with 


It  is  striking  that  the  expressions  in  (9)  for  the  coefficients  do  not 
depend  on  N.  It  may  be  verified  that 


(10) 


re  N 

ff(t)  -  E  (\ 

/n  n=n 


cos  cj  t  +  B 
n  n 


sin  0)  t)  Y 
n  ' 
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For  any  finite  N,  this  integrated  squared  difference  is  in  general 
positive.  However^  it  tends  to  0  as  N  tends  to  consequently, 

one  may  write  f(t)  as  an  infinite  series  of  harmonics, 

00 

(11)  f(t)  =  p.  [A  cos  to  t  +  B  sin  to  t)  ,  0  <  t  <  0  , 

n=0 

where  {u)^}  are  given  by  (6)  and  {A^}  and  are  given  by  (9)* 

The  right  hand  side  of  (13  )  is  called  the  Fourier  series  expansion  of 
f(t).  It  should  be  noted  that,  unless  f(t)  is  a  sufficiently  well 
behaved  function,  this  infinite  series  does  not  necessarily  converge  at 
each  value  of  t.  In  order  to  emphasize  this  fact,  instead  of  writing 
an  equality  sign  in  (ll)  one  sometimes  writes 

00 

(12)  f(t)  ~  P  {A  cos  to  t  +  B  sin  to  t) 

'  '  '  '  n  n  n  n 

n=0 

to  mean  that  the  expressions  in  (lO)  converge  to  zero  as  N  tends  to  w. 
However  in  this  paper  we  do  not  enqploy  the  notation  given  in  (12). 

Fourier  coefficients:  Given  any  periodic  function  f(‘)  one  can 
form  sequences  {A^}  and  defined  by  (9).  The  quantities  A^ 

and  B  are  called  the  Fourier  coefficients  of  the  function  f(t) .  From 
(10)  it  follows  that  they  provide  a  means  of  summarizing  the  continuiam 
of  numbers  which  constitute  a  function  defined  over  an  interval  by  means 
of  countably  infinitely  many  numbers.  Some  of  the  important  properties 
of  Fourier  coefficients  are  the  following  (proofs  are  left  to  the  reader.) 
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l)  If  a  function  f(t)  has  period  9,  its  Fourier  coefficients 


can  be  written  in  terms  of  an  integral  over  any  complete  period  t^  to 


to+  0: 


while  for  n  >  t. 


1  r 

‘o  ■  I  f  <■(*>  “  > 
^0 


A  = 
n 


(15) 


2  rV® 


f(t)  cos(n  ^  t)  dt  • 


®n=  0 


r 


0 
t„+Q 


f(t)  sin(n  ^  t)  dt  . 


2)  If  a  periodic  function  f(t)  is  even,  in  the  sense  that  for 
all  t 


f(.t)  =  f(t)  , 


then  the  sine  coefficients  B  vanish, 

n  ^ 


B  =0  for  all  n  , 
n  ^ 


and 
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5)  If  a  periodic  function  f(t)  is  odd>  in  the  sense  that  for 
all  t 

f(.t)  =  .f(t)  , 

then  the  cosine  coefficients  vanish, 


A  =  0  for  all  n  , 
n  ' 


and  for  n  >  1 


(15) 


B 


=  -  f 

®  Jo 


0/2 


f(t)  sin(n  ^  t)  dt 


4)  If  the  periodic  function  f(t)  is  absolutely  integrable 


r® 

/  lf(t)i 

A 


dt  <  00  , 


then 


(16) 


lim  A  =  11m  B  =0 

n  n 

n  "►  00  n  00 


If  f(t)  is  k-times  differentiable,  and  its  k-th  derivative  f^^^(t) 
is  absolutely  integrable,  then 


(IT) 


lim  n  A  =  lim  n  B  =0 
n  n 

n  00  n  00 
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Complex  Form  of  the  Fourier  Coefficients:  The  envelope  and 

phase  cp^  of  the  Fourier  coefficients  and  is  defined  by  (for 

n  >  0) 

■  g 

(18)  R  =  / ,  (p  =  tan"^  . 

'  '  n  V  n  n  '  A 

n 

It  is  easily  verified  that 


(19) 


A^  cos(n  ^  t)  +  B^  sin(n  ^  t) 

-  \  T  ‘  ■ 


In  terms  of  the  env’elope  and  phase  coefficients  the  Foirrier  series  expan¬ 
sion  of  a  periodic  function  f(t)  may  be  written 

00 

(20)  f(t)  =  ^  \  cos(n  1^  t  -  tp^)  . 

n=0 

In  order  to  understand  the  intuitive  meaning  of  the  envelope  and  phase, 
we  introduce  the  complex  form  of  the  Fourier  coefficients. 

For  ease  of  manipulation  it  is  frequently  desirable  to  write  the 
Fourier  series  as  an  expansion  in  complex  harmonics  (where  i  =  : 

(21)  exp[in  ^  t]  =  cos(n  ^  t)  +  i  sin(n  ^  t)  . 


Thus  let  be  the  coefficient  in  the  expansion 
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(22) 


f(t)  =  T  * 


n=-oo 


The  quantities  ere  called  the  complex  Fourier  coefficients  of  f(t). 

To  determine  the  relation  between  the  various  Fourier  coefficients, 
we  write  (20)  in  the  form 


00 

f(t)  =  Rq  +  I  R^(exp[i(n  ^  t  -  cp^)]  +  exp[i(-n  ^  t  +  qp^)]} 


(23) 


n=l 


=  ^0  ^  exp(in  ^t) 

n=l 

+  5^  I  ^-n  exp(in  ^  t) 


n=-l 


Comparing  (22)  and  (23)  we  see  that 


for  n  >  1 


<^0-^0- %  -  I  '■<*>  > 


4  R  exp(-iq)  ) 

I  (R^  cos  qp„  -  iR„  sin  cp^ ) 


'n  n  'n 


4  (A  -  iB  ) 
2  n  n 


=z  ^  J  f(t)  {cos(n  ~  t)  -i  sin(n  ^  t))  dt 


-  i  f‘ 

“  Jo 


f(t)  exp[-i(n  ^  t)]  dt  , 
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and  for  n  <  -1, 


C  =  “  R  exp(i(p  ) 
n  2  -n 


I  w  „  * 


■  i  r 
-  i  r 

»  Jo 


f(t)  {cos(-n^t)  dt 


f(t)  exp[-i(n  ^  t)]  dt 


One  sees  that  the  complex  Foiirier  coefficients  are  given  by  a  single 


formula  (valid  for  n  =  0,  -1,  ^2,  . . * ) • 


(24) 


P  ^  1  re 
^n  0 


/  f(t) 


exp[-i(n  ^  t)]  dt 


In  general  is  a  con5>lex  niimbei',  which  may  be  written  in  polar  form: 


(25) 


C  -  R  e 
n  n 


defining 


-n 


=  R 


=  -9. 


From  (25)  one  sees  that  the  envelope  R^  and  the  phase  9^  are  the  polar 
coordinates  of  the  complex  Fourier  coefficient  C^. 
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Equation  (24)  is  one  instance  of  the  fact  that  the  complex  Fourier 
series  (2?)  is  easier  to  manipulate  than  is  the  real  Fourier  series  (ll). 
Another  instance  of  this  fact  is  given  by  the  following  derivation  of  the 
inportaiit  convolution  theorein. 

Convolution  theorem.  Let  fj^(t)  and  ^2^^^  square-integrable 
functions  with  period  G,  and  respective  complex  Fourier  series 

00 

=  Yy  ^  >  J  =  1^2  . 

n=-oo 


The  function  f,(‘)  defined  hy 


(26) 


re 

f^(t)  =  J  f^(s)  f2(t  -  s)  ds 


is  called  the  convolution  of  often  written 


f^  =  f^  *  fg 


Now 

(27)  fj^(s)  f2(t  -  s)  =  ^  f^(s)  (Cg)^  exp  [in  ^  (t  -  s)]  . 

n=-oo 

Integrating  both  sides  of  (27)  over  the  interval  0  <  s  <  9,  it  follows 
that 


(28) 


f3(t)  =  5)  exp[in  ^  t]  (C^)^  (Cg)^ 


n=-<» 


IT 


Equation  (28)  is  a  fundamental  formula;  expressing  the  convolution  of 
two  functions  in  terms  of  their  Fourier  coefficients.  From  (28)  it 
follows  that 

(29)  (Cj)jj  =  I  exp[-i(n  ^  t)]  dt  =  (C^)^  (Cg)^  . 

In  words,  the  conplex  Foiarier  coefficient  convolution 

fj(0  is  the  product  of  the  complex  Fourier  coefficients 
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5  •  Windows 


I 

I 

I 

I 

I 


The  notion  of  a  Fourier  series  derives  its  usefulness  from  the  idea 
that  it  enables  one  to  approximately  represent  an  arbitrary  function 
f(t)  as  a  harmonic  polynomial  of  some  finite  degree  N.  The  question 
naturally  arises:  how  large  need  N  be  chosen  in  order  that  the  harmonic 
polynomial  f^^Ct)  defined  by  (2.1)  can  be  considered  to  be  a  good  approxima- 
tlon  to  f(t)?  Indeed,  the  question  needs  to  be  examined  whether 

(1)  lim  fj^(t)  =  f(t) 

N  00 

at  each  t  in  the  interval  0  <  t  <  0.  In  this  section  we  develop  the 
tools  to  answer  such  questions. 

We  first  obtain  a  representation  for  terms  of  f(t).  For 

n  >  1, 


A  cos  u)  t  +  B  sin  o)  t 
n  n  n  n 


I 


G 


.  I  f(x)  {cos  u)  X  cos  0)  t  +  sin  u)  x  sin  U)  t)  dx 


2 

=  7:  I  f(x)  cos  u)  (x  -  t)  dx  . 
®  Jn  n'  ' 


Consequently, 


(2) 


1  r® 

fj,(0)  =  I {1+2  cos  (0^(x  -  t)  + 
=  //  ?  - 


+  2  cos  Wjj(x  -  t)}  f(x)  dx 


-)  f(x)  dx 
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defining 


(3)  =1+2  cos  z  +  2  cos  2z  +  ..•  +  2  cos  Nz  . 

The  function  is  called  Dirichlet*s  kernel.  A  graph  of  i® 

given  in  Figure  3A. 

One  may  verify  that 

sin(N  +  i)z 

(1.)  V*>  ■  — T -  • 

Sin  ^  z 


To  prove  (4)  we  write 

sin(^  z)  Djj(z)  =  sin  z  +  2  sin  i  z  cos  z  +  , . . 

+  2  sin  ^  z  cos  Nz 

13  1 

=  sin  2  2  +  sin  ^  z  -  sin  ^  z  +  ... 

+  sin(N  +  ~)z  -  sin(N  -  ^)z 


=  sln(N  +  |)z  . 

The  function  1^(2)  is  an  even  periodic  function  with  period  2jt. 
Consequently  it  suffices  to  graph  it  for  lz|  <  jt.  It  achieves  its  maxi- 
mum  in  +his  interval  at  z  =  0,  where  it  has  the  value 


20 


Djj(O)  =  2N  +  1  . 


It  has  zeros  at  the  points  z  satisfying  sin(N  +  4)z  =  0  so  that 

C 

(N  +  thus  the  zeroes  of 

+  2it  +  4it 

2N  +  1^’2N+1^'**‘ 

Equation  (2)  shows  that  the  harmonic  polynomial  is  actually 

an  integral  averaging  over  the  values  of  f(t)  weighted  by  the  kernel 
~  Dj^(2it  — - — ).  Using  an  analogy  from  communication  theory, 
he  regarded  as  the  impression  obtained  of  the  function  f(t)  when  it  is 
viewed  through  a  window  (or  channel)  of  variable  transmission  properties 
given  by  the  weighting  function  — q — ^  thus  led  to  the 

following  formal  definition  of  the  notion  of  a  window. 

If  f(t)  and  g(t)  are  periodic  functions  with  period  6  such  that 

(5)  g(t)  =  f  G(t  -  x)  f(x)  dx  , 

we  say  that  G(t)  is  the  window  through  which  g(t)  views  f(t). 

The  truncated  Foxirier  series  ®  function  f(t)  views  the 

1  2^1 

function  thro\agh  a  window  ^  which  is  essentially  the  Dirichlet 

kernel.  By  examining  the  Dirichlet  kernel,  we  can  see  some  of  the  proper¬ 
ties  windows  should  have. 

A  window  G(t)  should  be  an  even  function,  so  that  it  gives  equal 
treatment  to  values  of  f(*)  on  both  sides  of  a  given  point  t: 

(6)  G(-t)  =  G(t)  . 
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A  window  G(t)  should  integrate  to  1, 


so  that  if  f(t)  is  identically  a  constant  c,  then  its  transmitted 
value  g(t)  will  he  a  constant  and  further  the  same  constant  c. 

A  window  G' t)  should  achieve  its  maximum  at  t  =  0, 

(8)  |G(t)  I  <  G(0)  for  all  t  , 


and  should  be  "concentrated"  as  much  as  possible  about  t  =  0  in  order 
that  the  value  g(t)  of  the  transmitted  function  g(-)  at  a  particular 
point  t  should  reflect  (as  much  as  possible)  the  behavior  of  f(*)  in 
the  neighborhood  of  t. 

The  Dirichlet  kernel  cannot  be  considered  to  be  satisfactorily  con¬ 
centrated  about  t  =  0.  One  reason  for  saying  this  is  the  relative 
(absolute)  size  of  the  second  largest  peak  (actually  a  negative  peak^  or 
trough)  to  the  size  of  the  largest  peak.  The  largest  peak  of  D^(z), 
which  occurs  at  z  =  0,  is  2N  +,  1  while  the  second  largest  peak 
(trough),  which  occurs  approximately  (for  large  N)  at  z  =  i3Jt/(2N  +  l), 
is  approximately  -(2N  +  l)  (2/3jt) .  The  ratio  of  size  of  second  largest 
peak  to  size  of  largest  peak  is  thus  approximately  given  by  (for  large  N) 
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A  second  reason  why  the  Dirichlet  kernel  must  be  considered  an 
unsatisfactory  window  comes  from  the  convergence  theory  of  Fourier  series. 
It  is  not  true  for  an  arbitrary  continuous  function  f(*)  that  the 
truncated  Fourier  series  converges  to  f(t)  as  N  tends  to 

for  this  to  hold,  some  supplementary  condition  (such  as  that  the  function 
f ( • )  be  of  bounded  variation)  must  be  imposed.  This  fact  is  somewhat 
disturbing  since  it  is  known  (Weierstrass *  theorem)  that  to  each  continuous 
function  f(t)  there  exists  a  sequence  of  harmonic  polynomials 
satisfying  (l). 

In  order  for  this  existence  theorem  to  be  of  practical  importance, 
methods  must  be  developed  for  constinicting  such  approximating  harmonic 
polynomials,  preferably  using  Fourier  coefficients.  One  of  the  first 
such  methods  was  discovered  by  Fejer.  He  proved  that  if  one  considers 
the  arithmetic  mean  fj^(t)  of  the  first  N  Fourier  sums  of  a  function 
f(t). 


then  ^j^(t)  is  a  harmonic  polynomial  of  degree  N,  and  the  sequence 
fj^(t)  converges  uniformly  to  f(t)  if  f(t)  is  a  continuous  periodic 
function. 

One  can  give  an  explicit  expression  for  terms  of  the 

Fourier  coefficients  of  f(t): 


(10) 


■■  I  ^  -  N  + 

n=:0  \  / 


cos 


U)  t 
n 


B  sin  (0  1 
n  n 
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As  an  integral  over  f(t)  one  may  vrite 


(11) 


Fu+l(2it  ^  Q  f(x)  dx  , 


defining 


(12) 


■ 


N  +  1 


1  > 

sin(N  +  l)^z 

]  I 

sin 


We  call  the  FeJ^r  kernel.  It  is  graphed  in  Figure  JA.  In  words, 

we  may  express  (ll)  as  follows:  the  N-th  Fejer  approximation 

corresponds  to  viewing  f(t)  through  the  window  ~  — s — )• 

y  JN  y 

To  prove  (ll),  one  uses  (2),  and  the  trigonometric  identity 

2 


(15) 


N  sin 

E 

n=0 


in(n  +  |)z 


.  1 
sin  ^z 


sin(N  +  l)|z 

^  I 

sin  ^ 


The  Fej^r  kernel  seems  to  provide  a  more  efficient  window  than  the 
Dirichlet  kernel  since  it  is  more  "concentrated"  about  t  =  0.  The  largest 
peak  of  F^(-)  is  N  +  1  while  the  second  largest  peak  [at  approximately 
z  =  5n/(N  +  l)  for  large  N]  is  approximately  (N  +  l)(— )  .  The  ratio 
of  second  largest  peak  to  the  largest  peak  is  thus  (for  large  N) 


-  )  =  0.04  , 


compared  to  0.21  in  the  case  of  the  Dirichlet  kernel. 

It  should  be  pointed  out  that  the  ratio  of  size  of  second  largest 

peak  to  size  of  largest  peak  is  only  one  of  the  ways  that  have  been 

suggested  to  compare  (in  a  very  rough  way)  the  degree  of  "concentration" 
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of  two  windows}  however  it  would  seem  to  be  valid  oiily  in  the  case  that 
their  second  largest  peaks  occur  at  the  same  point.  Unfortunately  there 
does  not  seem  to  be  any  universally  valid  criterion  for  comparing  the 
"concentration"  of  two  windows;  in  the  sequel,  a  number  of  such  criteria 
will  be  mentioned. 

The  introduction  of  the  FeJ^r  means  makes  us  aware  that  the 

truncated  Fourier  series  is  not  the  only  way  in  which  the  first  N 
Fourier  coefficients  of  a  function  may  be  used  to  form  a  harmonic 
approximation.  Various  other  possibilities  that  have  been  suggested  are 
as  follows. 

The  Modified  Truncated  Fourier  Series.  Because  of  the  window  to 
which  it  leads,  various  authors  have  considered  instead  of  the  truncated 
Fourier  series  modified  expression 

(U)  f*(t)  =  fjj(t)  -  I  (Ajj  cos  +  Bjj  sin  . 

It  is  easily  verified  that 

(15)  I  DJJ(2«  f(x)  dx 

where  I^(z)  is  the  modified  Dirichlet  kernel  defined  by 
I^(z)  =  Djj(z)  -  cos  Nz 

=  1  +  2  cos  z  +  2  cos  2z  +  ...  +2  cos(N  -  l)z  +  cos  Nz 

sin  Nz 
tan  ^  z 

(see  Figure  3A  for  a  graph  of  D*(z).) 

2^ 


Tukey  ineans*  Another  way  to  form  a  harmonic  approximation  to  f(t) 


is  to  form  the  mean 

(IT)  ^(t)  =2  +  i;:  fjjCt  +  +  i;:  -  2n^ 

which  the  author  calls  the  Tukey  mean  (of  the  truncated  Fourier  series) 
because  of  its  relation  to  certain  procedures  recommended  by  John  W.  Tukey 
(see  Blachman  and  Tukey  (1958)^  P*  1*^)  the  spectral  analysis  of  time 
series.  To  find  the  window  corresponding  to  Tukey  means,  we  write 


defining 

(19)  I^(z)  -  i  !..(.)  1  1  +  2)  ,  i  .  1)  . 

We  call  Tukey  kernel  (it  is  graphed  in  Figure  3A) .  Intuitively, 

one  feels  that  the  Tukey  kernel  is  more  "concentrated"  than  either  the 
Dirichlet  kernel  or  the  Fejer  kernel,  and  therefore  provides  a  better 
harmonic  approximation. 

It  is  possible  to  explain  how  one  might  be  led  to  discover  the  Tukey 
kernel.  The  unsatisfactory  feature  of  the  modified  Dirichlet  kernel  (like 
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the  Dirlchlet  kernel)  is  that  the  absolute  size  of  its  second  largest 
peak  (actually,  trough),  which  occurs  at  z  =  3n/2N,  relative  to  its 
largest  peak  at  2  =  0,  is  approximately  l/5*  To  reduce  the  size  of 
the  secondary  peak,  one  combines  ^(^*)  with  a  shifted  version  of  itself, 
namely  Dg(z  +  ^)>  which  has  enoiigh  positivity  at  z  «  5n/2N  to  reduce 
the  negative  trough  which  I^(z)  possesses  there.  It  is  thus  possible 

to  arrive  at  a  class  of  possible  kernels, 

) 

(20)  .  a  I).(Z)  .  i  (1  -  a)  •  j)  *  Ds(z  -  1)} 


where  a  is  chosen  in  0  <  ct  <  1.  R.  W.  Hamming  and  J.  W.  Tukey,  at 
the  Bell  Telephone  Laboratories,  experimented  with  various  choices  of  oc, 
and  at  one  time  recommended  ot  -  0.5^. 


Lanczos  means.  The  mean 


(21) 


df 


has  essentially  been  recommended  by  C.  Lanczos  (see  Lanczos  (1956),  p.  227)* 
It  may  be  verified  that 


^  Q  . 

(22)  4^^(t)  =  I  ^  L0-  [x  -  t]j  f(x)  dx  , 


defining  the  Lanczos  kernel 


(23) 


du 
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Like  the  Tukey  kernel,  the  Lanczos  kernel  achieves  greater  concentration 
about  z  =  0  by  averaging  over  the  Dirichlet  kernel  so  as  to  reduce  the 
secondary  peaks. 
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k.  Coefficient  Windows 


One  way  of  describing  how  well  a  harmonic  polynomial  approximates  a 
function  f(t)  is  by  specifying  the  window  through  which  the  polynomial 
views  f(t).  From  the  i>oint  of  view  of  constructing  approximating  har- 
ncnic  polynomials,  it  is  preferable  to  use  formulas  for  the  polynomials 
in  terms  of  the  Fourier  coefficients  of  the  function  f(t).  We  are  thus 
led  to  the  notion  of  a  coefficient  window. 

The  harmonic  approximation  to  a  periodic  function  f(t)  with  period 
e  with  coefficient  window  (kjj(n),  n  =  0,  1,  .  . .  ,  N)  is  defined  to  be 
the  harmonic  polynomial 

N 

^ 

where  w  =  n(2jt/0)  and  A  and  B  are  the  Fourier  coefficients  of 
n  '  n  n 

f(t). 

In  Table  4A  we  tabulate  the  coefficient  windows  corresponding  to  the 
various  harmonic  approximations  considered  in  Section  3 . 

The  Fourier  transform 


N 

(2)  Kjj(z)  =  kjj(O)  +2  cos  jz  kjj(j) 

J 

is  defined  to  be  the  amplitude  window  of  the  harmonic  approximation. 
Using  (l)  one  may  verify  that 

(5)  =/q  I  ^  -  ^3)  f(x)  <bc  . 
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From  (5)  one  sees  that  the  true  window  through  which  the  harmonic  approxi¬ 
mation  f  .  (t)  views  f(x)  is  [up  to  a  change  of  scale  depending  on 
the  period  0  of  f(t)]  the  aniplitude  window  Note  that  ^^(2^) 

has  period  2n. 

At  n  =  0^  the  coefficient  window  always  has  the  value  1, 


(i^)  yo)  =  1  , 

since  we  desire  that 


We  also  define  the  coefficient  window  for  negative  values  of  n  in  such 
a  way  that  it  is  an  even  function: 


(5) 


kj^(-n)  =  l^(n)  ,  n  -  0^  -1>  . . .  ,  ^  . 


Instead  of  (2)  we  may  then  write 


(6) 


K  (z)  =  ^  cos  jz  k^(j) 
^  J=-N 


Inverting  (6)  we  have 


(7) 


1 


dz 


One  ad/antage  of  introducing  the  coefficient  windows  and  amplitude 
windows  is  that  the  period  0  of  the  periodic  fvinction  f  ( • )  under 


] 

] 

] 

] 

] 


30 


consideration  no  longer  explicitly  enters.  However,  a  nore  in^rtant 
advantage  is  that  we  can  give  a  general  treatment  of  the  properties  of 
harmonic  approximations.  In  order  to  do  this  it  is  convenient  to  intro¬ 
duce  still  another  stage  of  abstraction. 

If  k(u)  is  a  function,  defined  for  -oo  <  u  <  »,  such  that 

1)  k(0)  =  1 

ii)  k(-u)  =  k(u) 
iil)  k(u)  =0  for  |u|  >  1 


we  call  k(u)  a  coefficient  window  generator .  Its  Fourier  transform 


(8) 


K(z) 


k(u)  du  , 


-00  <  Z  <  00  , 


is  called  an  ait^litude  window  generator .  Note  that 

(9)  k(u)  =  r  e^'"^  K(z)  dz  ; 

J  -00 

since  K(z)  is  not  necessarily  absolutely  integrable  over  -oo  <  z  <  oo, 
the  integral  in  (9)  is  in  general  defined  as  a  limit  in  mean  square. 

Now,  let  M  be  a  positive  number  (in  practice,  M  will  be  a  member 
of  a  sequence  of  numbers  which  tend  to  oo  as  N  tends  to  «>) . 

One  may  define  a  coefficient  window  k^(u)  by 

(10)  kj^(n)  =  k(|)  . 

Note  that  the  window  defined  by  (lO)  satisfies  (4)  and  (5). 
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The  coefficient  windows  in  Table  kk  can  be  generated  by  a  formula 
of  the  form  of  (lO)  from  a  coefficient  window  generator  (see  Table  i;B). 

The  relationship  that  exists  between  M  and  N  is  determined  by 
the  requirement  that 


(11) 


for  n  =  N  +  1,  N  +  2, 


this  assximption  holds  in  all  the  cases  considered  in  Table  i+B. 

We  now  obtain  a  formula  for  the  amplitude  window  corresponding  to 
the  coefficient  window  defined  by  (lO).  Using  (ll)>  the  harmonic  poly¬ 
nomial  (l)  may  then  be  written 


(12) 


cos  0)  t  +  B  sin  u)  t) 
n  n  n 


Tt  (A  cos  u)  t  +  B  sin  w  t)  . 

n=0  W  ^  ^  ^  ^ 


We  next  use  (9)  to  obtain 


Since 
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2  cos  A  cos  B  =  cos(A  +  B)  +  cos(A  -  B) 


2  sin  A  sin  B  =  sin(A  +  B)  +  sin(A  -  B) 


it  follows  that  the  last  sum  in  (ij)  is  equal  to 


I  Ma, 


2  ^  1  n 

n=0 


/  .  ,  0  z\  .  f.  0  z 

cos  U)  (  t  +^77  "*'  cos  0)  (  t  “  7^  77 
nV  2n  My  n\  2n  M 


+  B 


sin  ui  ft  +  ^  +  sin  ^  ft  -  ^  ^ 

n\^  2n  My  n\.  2n  M 


/t  -  i 

2it  M 


Consequently,  recalling  that  f(t)  is  a  periodic  function  defined  for 
all  t  in  -oo  <  t  <  00, 


(14) 


K(z) 


t  + 1-  i  V  ft  t  -  -  - 

2it  M/  I  2n  M 


^00  y 

=  dz  K(z)  ff  t  + 

J  -00  \ 


9  z 


2jr  m;  ' 


to  prove  the  last  equation  note  that  K(z)  is  an  even  function  so  that 
letting  z*  =  -z, 


£  d.  KM  ^ I)  -£  - 1; 7)  • 

In  (14)  we  make  the  change  of  variable  y  =  t  4-  (0z/2jtM),  and  obtain 
the  following  conclusion^  for  the  coefficient  window  defined  by  (lO), 
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In  words,  this  conclusion  may  be  expressed  as  follows:  the  harmonic 
approximation  f^r-  (t)  corresponds  to  viewing  f(t)  through  a  window 
on  the  infinite  real  line  with  transmission  function 


(15) 


2nM  ySitM 

e  \e 


which  is  (up  to  a  scale  factor)  the  amplitude  window  generator  K(z) 
corresponding  to  the  coefficient  window  generator  k(u) .  By  writing  the 
window  relating  ^]\j^}^(^)  f‘('t)  as  a  function  on  the  infinite  real 

line  we  have  reduced  the  study  of  its  properties  to  the  study  of  the 
properties  of  the  amplitude  window  generator  K(z). 

It  is  of  interest  to  obtain  in  terms  of  K(z)  an  expression  for 
the  window  relating  f^,^(t)  and  f(t)  as  a  function  on  the  basic 
interval  -0/2  <  t  <  0/2,  From  (l4)  one  may  write 

^  r(2k+i)| 

(16)  f  (t)  -  S  yi)  f(y)  dy  . 

In  each  integral  in  (l6)  make  the  change  of  variable  z  =  y  -  J0.  Since 


f(z  +  je)  =  f(z) 


we  obtain 


(17) 


dz  f(z) 


2  ^  /Sf  (t  - 

I  =-00  \ 


Z 
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Thus  the  window  relating 
-0/2  <  t  <  0/2  is 


and  f(t)  on  the  interval 


(18)  ^  i;  /m  ^  t  -  M2nj)  . 

This  f\indainental  result  may  be  summed  up  as  follows: 
The  amplitude  window 


(19) 


00 

^  COS  nz 


0  <  z  <  2n 


corresponding  to  the  coefficient  window 


is  given  by 


(so) 


“m<"> 


where  K(  z )  is  the  amplitude  window  generator  obtained  from  the  coefficient 
window  generator  k(u)  ^  (8). 

To  illustrate  the  meaning  of  the  fundamental  relation  given  by  (20), 

let  us  consider  the  example  of  Fejer  means.  If  f(t)  is  a  function  with 

period  0  and  with  Fourier  coefficients  A  and  B  ,  and  if 

^  n  n' 

(21)  f„  T,(t)  =  fl  -  (A  cos  w  t  +  B  sin  (x)  t}  , 

'  N,F^  '  y  N  y  n  n  n  n  ^ 

then  by  Table  4A 

f  0 

(SS)  f„_y(t)  ^K0U-t)J  f(x)  ax 
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where 


(25) 


However,  the  harmonic  polynomial  in  (21)  can  be  written 


(24) 


N  /  \ 


{A  cos 


(a)  t 

n 


+  B  sin 


(a)  t) 

n 


where  M  =  N  and 


(25) 


k(u)  =  1  -  |u|  ,  |u|  <  1 


=  0  ,  |u|  >  1 


with  Fo\irier  transform 


(26) 


K(z)  ~  k(u)  du  =  i  J  (l  -  u)  cos  uz  du 

1  [sin(z/2)l^ 

-2n\  ^72/  • 


What  (20)  says  is  that 


(27) 


I  i=‘”  I 
"  l*lni  J 


An  independent  verification  that  (27)  holds  can  be  obtained  by  using  the 
expansion 


56 


(28) 


1 


1 


2  "  Ij  2  * 

sin  z  J=-a>  (z  +  nj) 


To  do  this  note  that  (27)  holds  if 


sin  ^  Nz^ 
sin  ^  z 


=  2 

j=-' 


sin  N(z  -  2itj)/2 
^  (z  -  2)tj) 


<»  rs: 

ir 


.  1  rr  2 

Sin  ^  Nz^ 


J=-O0  z  .  Jtj 


,ch  is 


an  immediate  consequence  of  (28) 


(29) 


k(u)  =  1  - 

6u^  +  6  lup  , 

|ul 

y 

=  2(1 

-  kl9 , 

l< 

kl 

<  L  ^ 

=  0  , 

lu| 

>  1 

y 

if 


(30)  y z)  =2^  ' 

and  if  M  is  an  even  integer  less  than  N,  then 


To  prove  (3I)  we  use  the  fact,  which  follows  from  (20),  that 


if 


37 


(52) 


K^(z)  =  2itM  K(M(z  -  2nj)) 
J=-» 


where 


(55) 


Therefore,  assuming  M  is  even. 


f  “  ,L  f  kt  ■  ^)}y 


(54) 


5 

4t^  J 


Mz|‘‘  I  ■" 


s  (I- 

I  =-00  \ 


-4 


To  sxiin  the  last  series  in  (54)  we  differentiate  (28)  and  obtain 


dz 


E  (z  +  «J)  ^  =  (-2)  J)  (z  +  nj)  ^ 


J=-“ 


=  ^  sin"^  z  =  (-2)  sin"^  z  cos  z  , 


J=- 

„-„-5 


^  E  (^  ■*■  =  ("5)  D  (z  +  «j) 


-4 


J=- 


j=-00 


=  fsin”^  z  cos  z) 
dz 


-5  /  .  -k 

=  -sin  z  sin  z  +  cos  z  (-5)  sin  z  cos 
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=  (-3)  sin”^  z  -^cos^  2  +  j 
=  (-5)  sin*^  z  -  j  sin^ 


sin 


4 


Thus 

00 

(35) 

D 

j=-00 

(z  +  Jtj)' 

00 

(36) 

L 

j=-00 

(1  - 

Combining  (36)  and  (3^);  one  obtains  (31)* 

From  (20)  we  also  obtain  an  approximate  expression  for  the  aiiiplitude 
window 


(37) 


0  <  z  <  2n 


corresponding  to  the  coefficient  window 


approximately, 


(38) 


Kj^(z)  =  2m  K(Mz)  . 


In  writing  (38),  we  are  assmning  that  K(z)  becomes  negligibly  small 
for  |z I  >  2nM. 
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5*  Evaluation  of  Fourier  coefficients  using  equi«spaced  points* 


It  may  be  difficult  to  obtain  the  Fourier  coefficients  of  a  periodic 
function  f(t),  with  period  0,  because  of  the  difficulty  in  evaluating 
the  integrals  defining  the  coefficients.  Further,  the  function  f(t) 
may  not  be  known  at  all  points  t  in  the  interval  0  <  <  0,  but  may 

be  known  (especially  if  it  is  an  empirically  observed  function)  only  at 
a  set  of  equi- distantly  spaced  points.  In  this  section  we  consider  the 
problem  of  evaluating  the  Fourier  coefficients 


(1) 


1  r® 

^  =  e  Jo  ^ 

f  (t)  cos(n  ^  dt  , 

=  I  /o  T  ' 


n  >  1  , 


n  >  1  , 


when  the  values  of  the  function  f(t)  are  known  only  at  the  r  equispaced 
points  t^,  t^,  ...  >  defined  by 


(2) 


tj  =  f  J  ,  j  =  0,  1, 


r  -  1  . 


In  the  theory  of  Riemann  integration  it  is  shown  that  if  g(t)  is  a 
continuous  function,  then 

(3)  f  g(t)  dt  =  lim  I  ^  i)  . 

Jq  r  -*co  ^  j=0  / 

In  view  of  (3),  it  seems  nattiral  to  approximate  the  Fourier  coefficients 
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Aq,  A^,  and  by  the  respective  quantities 


The  quantities  defined  in  are  called  the  Fourier  coefficients  of  f(t) 

over  the  discrete  set  of  points  {t^,  t^^,  ...  ,  t^} .  For  brevity  we 

sometimes  call  them  the  discrete  Fourier  coefficients  of  f(t). 

Fortunately  it  is  possible  to  give  exact  expressions  for  the  relations 

between  the  Fourier  coefficients  and  the  discrete  Fourier  coefficients. 

We  first  notice  that  the  set  of  numbers  (A  ,  n  =  0#  1,  2,  ...} 

n;r^ 

actually  consists  of  at  most  r  different  integers!  Indeed  if  n  is  an 
integer  from  1  to  r,  then  for  any  integer  k  it  holds  for  any  t 
in  (t^^  t^^  ...  ,  t^} 


cos(kr  +  n)  ^  t*  = 

(5) 

cos(kr  -  n)  —  t.  == 

^  J 

In  words,  given  values  only  at  the  points  t^,  t^,  ...  ,  t^,  a  harmonic 
cos  m  ^  t,  with  frequency  m  cannot  be  distinguished  from  a  har- 

2  Jt 

monic  cos  n  t  if  m  is  related  to  n  by 

(6)  m=kr  +  n  or  m=kr-n 
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for  some  integer  k.  To  describe  this  situation  we  introduce  the  following 

2  Jt 

intuitive  terminology;  we  call  the  frequency  m  ~  an  alias  of  the  fre- 
2u  0 

quency  n  -g-  ever  the  points  tj  =  J  ~  if  m  is  related  to  n  by  (6). 
The  fact  that  aliases  exist  is  called  the  "aliasing  effect  of  sampling." 

For  sines,  instead  of  (5)  we  have 


(7) 


sin(kr  +  n)  t 


-sin(kr  -  n)  ^  =  sin(ji  ^  . 

The  proof  of  (5)  and  (7)  is  immediate;  for  j  =  0,  1,  ...  ,  r, 
cos  •|(kr  +  n)  ^  =  cos  |^(kr  +  n) 

=  cos(^kr  cos^n  -sin^kr  sin^n 

=  ¥  (f  j)}  ' 


sin 


•|^(kr  +  n) 


-  si] 


kr 


=  sinl 


/n^ 


,  j  2jt  /e  , 

sin  in  —  (-  J 


and  so  on. 
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Pictorial  representation  of  aliasing.  Let  us  represent  the  frequencies 


n  on  a  line  running  from  0  to  with  the  integer  n  on  the  line 

2  Jt 

representing  the  frequency  n  -g-.  Then  we  can  represent  Uie  aliasing  as 

a  "folding"  of  the  line  into  the  interval  0  to  r  (see  Figure  5A)» 

There  is  thus  a  confusion  of  frequencies  due  to  the  fact  that  two  harmonics 

whose  frequencies  are  related  by  (6)  have  the  same  values  at  the  sampling 

points  t  .  One  refers  to  this  confusion  of  frequencies  as  "aliasing" 

J 

2it 

because  one  can  regard  the  various  different  frequencies  (kr  +  n)  -g- 

2tc  2  Jt 

and  (kr  -  n)  -y  as  adopting  the  name  of  the  frequency  n  which  is 

the  lowest  positive  frequency  of  all  those  which  are  aliased. 

The  number  of  distinct  Fourier  coefficients.  From  (5)  and  (7)  one 
sees  that  in  order  to  know  the  values  of  all  the  discrete  Fourier  coeffi¬ 
cients  A  and  B  it  suffices  to  know  them  for 
n;r  n;r 

n  =  0,  1,  . . .  ,  “  (r  -  l)  if  r  is  odd  , 

(8) 

=  0,  1,  . . .  ,  ^  r  if  r  is  even  . 

The  two  equations  in  (8)  can  be  expressed  by  one  equation  which  holds 
for  any  value  of  r: 

(8')  n  =  0,  1,  . . .  ,  I  r 

where  the  square  brackets  indicate  that  we  take  the  integral  part  of  the 
nturiber  within  the  brackets. 
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New  =  0  and  if  r  is  even  then  -  0  .  Consequently  the 

r  observation  points  f(t  ),  J  =  0,  1,  ,  r  -  1  always  yield  exactly 

J 

r  distinct  discrete  Fourier  coefficients.  Further,  the  relation  bet'rfeen 

these  discrete  Fourier  coefficients  A  and  B  is  given  by 

njr  njr 


(9) 


A-  =  ^  A  , 

Ojr  0  rk 

00 

A  =  A  +  (A  _  I  A  ,  ) 

n)r  n  '  rk+n  rk-n' 

00 

3  =B  +  y)(B_-B,  ). 

n;r  n  rk+n  rk-n 

'  k=l 


To  prove  (9)^  substitute  the  Poiirier  series  expansion 


f(t/ 


y.  (A  cos  n  ^  t  +  B  sin  n  ^  t) 
^  n  0  n  0 


in  (4),  and  use  (5)  and  (7)  as  well  as  the  fact  that 


>  =  0  if  n  /  0,  r,  2r,  . . . 

E  sir/n  ~ 

J=0  \  / 

/ 

which  follows  from  the  fact  that 


r 

E 

j=0  ^ 


exp 


i  n  2n 


1  -  exp 


1  n 


2n 
r  J 


kk 


From  (9)  one  obtains  the  following  conclusion:  given  the  values  of 

a  function  at  a  discrete  set  of  points,  one  can  not  obtain  the  true  harmonic 

spectrum  of  the  function  which  is  contained  in  the  Fourier  coefficients . 

Rather  one  can  obtain  estimates  of  the  Fourier  coefficients  of  the  low 

frequency  harmonics,  these  estimates  being  somewhat  "contaminated"  by 

higher  frequency  contributions »  In  order  for  the  discrete  Fourier 

coefficients  A  and  B  x.-x  ^x-  xxi. 

n;r  n>r  to  be  satisfactory  approximations  to  the 

Fourier  coefficients  and  B^,  it  is  necessary  and  sufficient  that 

the  Fourier  coefficients  be  negligible  for 


n  >1  (r  -  1) 


1 

2  ^ 


if  r  is  odd  , 


if  r  is  even  . 


2 

For  example,  if  the  Fourier  coefficients  are  of  the  order  of  l/n  ,  then 

the  difference  between  A  and  A  (and  similarly  between  B  and 

n;r  n  ^  n>r 

2 

B  )  is  of  the  order  of  l/r  . 
n'  ' 

Nevertheless,  if  our  aim  is  merely  go  approximate  the  function  f(t) 
by  a  harmonic  polynomial,  knowing  the  values  of  the  function  at  a  discrete 
set  of  points  provides  almost  as  good  an  approximation  as  knowing  it  over 
an  interval. 

Harmonic  interpolation:  Let  f(t)  be  a  function  with  period  0, 

and  discrete  Fourier  coefficients  A  and  B  defined  by  (k) . 

n;r  n^r  ^  ' 

Given  a  coefficient  window  the  function 

{\;r  +  ®njr  f  ^)} 
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defines  a  harnionic  approximation  to  f(t)  which  can  be  regarded  as  arising 
from  interpolation  of  the  values  of  the  function  at  t^,  • .  •  , 
the  subscript  I  is  to  connote  interpolation.  It  is  shown  below 

that  in  terms  of  the  values  of  f(t)  at  these  points, 


(11) 


where  aii5>litude  window  corresponding  to  the  coefficient 

window  kjj(n) .  It  should  be  noted  that  the  right  hand  side  of  (ll)  can 
be  regarded  as  a  discrete  approximation  to  the  Riemann  integral  on  the 
right  hand  side  of  equation  (j)  of  section  4. 

To  prove  (ll),  we  write  for  n  >  1  (defining  =  2j(n/0) 


A  cos  0)  t  +  B  sin  o)  t 
n;r  n  n;r  n 


2 

“  5^/  f(t  J  {cos  u)  t,  cos  to  t  +  sin  to  t.  sin  to  t) 


P 

=  7  S  cos  (0  (t  -  t  )  . 

r  jtb  J  J 


Consequently 


1 


+  2kjj(N)  cos  u)^(t  -  tj))  . 


The  proof  of  (ll)  is  complete. 
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the  inter- 


From  (ll)  one  sees  that  for  certain  choices  of 
polatory  polynomial  is  exactly  equal  to  the  function  f(t)  at  the  points 
t  ;  in  symbols, 

V 

(12)  ,3  =  0,  1,  ,  r  . 

In  order  for  (l2)  to  hold  it  suffices  that 


(13) 


for  any  integer 


J  /  0  . 


For  a  given  value  of  r,  (ij)  implies  the  following  relation  between  r 
and  N  for  the  various  coefficient  windows  we  have  considered: 


Dirichlet 

r 

=  2N  +  1 

Modified  Dirichlet 

r 

=  2N 

Fejfer 

r 

=  N  +  1 

Tukey 

r 

=  N 

Parzen 

r 

=  N/2 

Explicitly,  we  have  the  following  relations  for  t  =  (t^,  ,  t^  2,^^ 

defining  for  any  integers  n  and  r 
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(1) 


(14)  C^.^=i  ^|f(tj)exp[-inf  j], 

(15)  D^.r(t)  =  oos(n  f  t)  +  sir(n  f  t) 


(16) 


Exact  Interpolation  with  Dirichlet  kernel:  for  r 


f(t)  = 


(r-l)/2 


n=0 


n:r' 


(r-l)/2  r.  2it  1 

n=-(rtl)/2  nir  L  &  ^ 


(ii)  Exact  Interpolation  with  modified  Dirichlet  kernel: 


even, 


(17) 


(r/2)-l 

f(t)  =  A-  +  5;  D  (t) 

0>r  n;r' 


+  A  cos(^  t 
r/2;r  V  0 


(iii)  Exact  Interpolation  with  Fejer  kernel: 


r-1 


(18) 


n=-r 


=  „?0  ■  V 


1  -  -  C  exp. 
tJ  njr 


r.  2n  .  1 
"  ^  T 


(iv)  Exact  Interpolation  with  Tukey  kernel: 


(19) 


f(t)  =  1  + 

n=0  ^  ' 


odd. 


for  r 
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(v)  Exact  Interpolation  with  Parzen  kernel: 


(.0)  f(t)  .  i  {i  -  6(^J  * 
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Tfeble  kB:  Window  Generators  (continued 
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rtfMTt  3A.  Windows. 


Figuri  4A.  Amplitude  Window  Gtnwalors. 
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Figure  4a".  Continued  on  an  enlarged  scale. 


Figure  4b«  Coefficient  Window  Generators 


FIgur*  4C  SoMt  windows  normallztd  to  luivo  opproxlmatoly  tamo  htlght  at  cantor  froguancy. 


Figure  5A.  Pictorial  representation  of  aliasing  of  Frequencies. 
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